RSIMS: Large-Scale Heterogeneous Remote Sensing Images Management System

With the remarkable development and progress of earth-observation techniques, remote sensing data keep growing rapidly their volume has reached exabyte scale. However, it’s still a big challenge to manage process such huge amounts with complex diverse structures. This paper designs realizes distributed storage system for large-scale storage, access, retrieval, called RSIMS (remote images management system), which is composed three sub-modules: RSIAPI, RSIMeta, RSIData. Structured text metadata different are all stored in RSIMeta based on set uniform models, then indexed by multi-level Hilbert grids high spatiotemporal retrieval performance. Unstructured binary image files RSIData, provides large scalable capacity efficient GDAL (Geospatial Data Abstraction Library) compatible I/O interfaces. Popular GIS software tools (e.g., QGIS, ArcGIS, rasterio) can access RSIData directly. RSIAPI users interfaces hiding inner structures RSIMS. The test results show that store from various sources stable performance, easy deploy use.